LOAN DOCUMENT 


PHOTOGRAPH THIS SHEET 
a 
: LEVEL INVENTORY 
S 
DOCUMENT IDENTIFICATION 
.¢) 
5 H 
| A 
N 
D 
DISTRIBUTION STATEMENT L 
LAC ft POsitny Sin ~ EK 
NTIS GRAAI Ng 
TRAC oO 
'UNANNOUNCEP OG 
JUSTIFICATION 
a 
ee 
rs I 
ae 
T 
piRTION H 
DATE ACCESSIONED 
A-| C 
A 
DISTRIBUTION STAMP 
R 
E 


19981223 003 


DATE RECEIVED IN DTIC 


DATE RETURNED 


Reproduced From 
Best Available Copy 


REGISTERED OR CERTIFIED NUMBER 


PHOTOGRAPH THIS SHEET AND RETURN TO DTIC-FDAC 


DTIC ™ 70A 


DOCUMENT PROCESSING SHEET 


LOAN DOCUMENT 


Waa Bite ONS MAY Br LER? Li 


*) 

NAVAL ae 
ee “ 
“ar Neg A 


DEVELOPMENT 
CENTER 


. Jehasvilie, Werminster, Penasylvenie 


| SYSTEMS ANALYSIS AND ENGINEERING DEPARTMENT | 
f TECHNICAL MEMORANDUM 68-000-7 | 19 AUGUST 1968 9] 


LEAST SQUARES CURVE FITTING ROUTINE 
| USER'S GUIDE 


NO) DISTRIBUTION 
OPA TEMENT 


DEPARTMENT OF THE NAVY 
NAVAL AIR DEVELOPMENT CENTER 


JOHNSVILLE 
WARMINSTER, PA. 18974 


Systems Analysis and Engineering Department 


TECHNICAL MEMORANDUM 68-000-7 19 August 1968 


Least Squares Curve Fitting Routine 
User's Guide 


prederes by: R ofr ) Franke 


Robert’ J, Frank 


a tt ary" ~g. - pas 
Solomon Getz 


Reviewed by: 


SAED TM 68-000-7 
INTRODUCTION 


This technical memorandum .provides a complete set of input 
instructions for .the LEAST (Least Squares Curve Fitting Routine) 
developed at the Naval Air Development Center, Johnsville, Warminster, 
Pennsylvania. . The memorandum begins with a brief description of. the 
program's capability, followed by general information concerning input 
specification... The necessary.input variables are then explained.in. 
full, and format.specifications are provided.. Inputs for a sample 
problem are listed in appendix A, and the sample output is listed in 
appendix B. 
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DISCUSSION | 


General Program Description 


The Least Squares Curve Fitting Routine is designed primarily to 
derive a numerical relationship between a designated independent | 
variable and a. dependent variable by the method of least squares 
regression. The regression equation is an equation of the form: 

ate KM | 
Y = by + box + b,x + ae avs 


where 


Y = the independent variable 

X = the dependent’ variable 

M = the number of data points 

B. = constants. to be determined (i=1,M) 

KM = the maximum. degree of the equation | (KM=M- me 

The program calculates the errors involved in fitting raw data.to. a. 
mathematical curve including the. variance for each data point, the . 
average variance for.each coefficient, and the adjusted standard error 


of estimate. .For a complete explanation of regression equations, 
standard error of Sat are, and. variance, see reference (a). ? 


The program. will also. generate the. eéoerieients of. Legendre. ane 
-nomials or orthogonal polynomials if so desired. A.Legendre polynomial 


is a solution .of .Legendre's equation, which is the linear second order 
Sa equatson: 


oe es Sg tana 
: | ek RZ X= + n(n+l)y = 


where 


: | | | | | 

> = the second derivative of X with respect to Y 
X | | | | | 

oy = the first derivative of X with respect to Y. 
n = a given constant... 


An orthogonal polynomial..is one whose coefficients are mutually orthogonal 
with the coefficients .of another. polynomial; that is, two polynomials 
whose inner product..is equal to 0. In the program, the orthogonal 
coefficients are orthogonal to the regression POCESICIENE Ss 
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The user may select the maximum degree of the regression equation, 
although this willbe limited to. one Jess than the number of..data 
points; or if Legendre polynomials. are. generated, less than or equal 
to 10; or if orthogonal. coefficients are calculated, less than or 
equal to 20. 


A weighting system can .be.used.in order to put.more emphasis on 
points of greater significance in developing the regression equation. 
If the weighting system is not used, the program will assign all points 
a weighting factor of 1. | 


Preparation of the Data Deck... 


General Information | 


All input variables are specified on 80-column Hollerith cards. 
The inputs are either data or.control variables, In the following 
instructions, each input card..will.be considered in sequence. Each 
description will include.the. variable name as it appears in the program,.. 
the columns into which the variable is punched, the variable..type.in 
parenthesis (data or control-integer or decimal), .and.the. definition. of 
the variable with any needed. instructions. In any field, a.decimal 
variable must include the decimal point, and an integer variable must 


be right-justified and must.not include a decimal point. | 
Data Arrangement | 


Card 1 _ 
M cols. 1-5 (control-integer) 
KM cols. 6-10. (control-integer) 
ISW cols. 11-15 (control-integer) 
LP cols. 16-20 (control-integer) 
IW cols. 21-25. (control-integer) 


M is the number.of.raw data points to be read. 
KM is the maximum degree of the regression equation. .. 


ISW controls the production. of orthogonal polynomials....If ISW 
is equal to 1,.the coefficients. of. an orthogonal polynomial.will.be. 
generated; if ISW.is..equal. to 0, they will not be generated. The 
calculation of orthogonal polynomials limits the degree of the regres- 
sion equation to less than or equal.to 20. - 


LP controls the.production of Legendre polynomials. If. LP is 
equal to 1, the coefficients of.a.Legendre polynomial will. be..produced; . 
if LP is equal’to 0, they will not be calculated, The calculation of — ! 
Legendre polynomials limits the degree of the regression equation to 
less than or equal to 10. : a | 
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IW determines: if. a weighting system is to be used to place. ~ 
greater emphasis in. the regression. equation on. more significant.data .. 
points. If IW.equals 0, the. system.is. not used and the: program makes 
all weights equal.to 1. If IW.equals 1, weighting factors must be read 
in with each point. . 


Card 2. 


a... If IW is: equal to .0,..read in the.M data: points, each 
point occupying: 2.F10 fields with four points per card. .Place-the..... 
dependent variable (X;) in the first field and the: independent variable 
(F2;) in the second field. Use as.many cards. as necessary until all 
M points have been entered on cards. For example: 


X4 cols. 1-10 (data-decimal) . 
F2, cols. 11-20 (data-decimal) 
Xo cols. 21-30 (data-decimal) 
F27 cols. 31-40 (data decimal) 
etc. ° 
b. If IW is equal to 1, read in the M data.points.with. . 
their weight factors, each point and its. weight occupying. 3F10. fields 
with two points. per. card. Place the dependent variable (X;).in. the 
first field, the independent variable (F2;) in the second field, and. 
the weighting factor (Wj) in the third field, Use as many cards’ as neces- 
sary until all M points have been entered on cards. For. example: : 
X} cols, 1-10 (data-decimal) 
F2; cols. 11-20 (data-decimal 
W, cols. 21-30 (data-decimal) 
Xy cols. 31-40 (data-decimal) 
etc. | | | 
Multiple.runs. are possible by placing: new values of 


the variables .on.card 1 in back of the previous run and proceeding as 
before. A blank card will terminate the program. 
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REFERENCE 


(a) U. S. Air Force Project RAND: Unclassified.memo "Use of. Statistical 
Regression Analysis in Deriving Estimating. Relationships ," 
Concepts and.Procedures of Cost Analysis, by G. H. Fisher, 

June 1963 


SAED TM 68-000-7 


APPENDIX A 
_ SAMPLE PROBLEM INPUTS. 


- General Description 


A user wants. to determine two relationships; between an . independent . 
variable A and a dependent variable B, and.also between:.another.inde-.... | 
pendent variable .C and: a. dependent: variable D; using the method of — 
least squares regression. In the first case, he knows the coordinates 
of 9 points and he wishes the maximum degree of the regression. equation. 
to be equal to..8... He does:.not want.to use the weighting system, .and 
he does not want Legendre. or.orthogonal. polynomial. coefficients...In 
the second case, he knows the coordinates of 12 points, he wants the 
maximum degree of the regression to bell, and he wants the coefficients 
of both Legendre and orthogonal polynomials. Again he does not want to 
use a weighting system... | 


In the first run,. the user. inputs..the values of A into the F2 fields 
of the program.since: F2 is.the independent variable. He.also.inputs. . 
the values of B into the X fields of the -program.:. In the second case, 
he inputs the values of C into. the F2..fields..and.D into the X fields; 
the points for each case are.listed below. 


First case (B, A). eee 


io ts dea a mek aegis iar 
Second case (D,C). points. 


(1.65,1.50);. (2.421. 76); (4.10,1.65): (5.70,2.17): 
(7,65,2,43);° (11.3,2.48);. (15.7,3. 0); (21.6,3.05); 
(24.0,3.58); (34.2,3.12); (50.0,4.07); (76.1, 5.21) 


Problem. Inputs 


Card No, Variable - Value - Card Columns 
1 M i 5 
1 KM 8 10 
2 Xj. — 0.0 1-3 
2 F2y 0.0 <a © “ass 
2 Xo 90.0 _ + 21-24 
2 F29 ae ae «31-34 
2 X3 20,0. +45 41-44 
“a 3 F23 “3299. 51-54 
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Card No. Variable 
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Card Columns 


61-64 
71-74 
1-4 
11-14 
21-24 
31-34 


— 51-54 


61-64 
71-74 
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APPENDIX B- 
SAMPLE PROBLEM OUTPUT 


The following pages list the complete output of the Least Squares — 
Regression Routine for the problem described in appendix A. Note that 
SIGMA is the adjusted standard error.of estimate. .In.the. chart at 
the bottom of each output: page,X(I) is the dependent. variable, .F(I).is. - 
the given value. of the.independent variable, Y(I) is the value of .the. 
independent variable calculated. using. the regression coefficients, 
DELY(I) is the calculated. value of the independent: variable .minus:the... 
given value, and W(I). is the weighting factor....Note also,.in.the... 
second run, that the regression equation was limited.to: a maximum degree 
of 10, due to the calculation of the Legendre coefficients. 
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